CLAIMS 

What is claimed is: 

We claim: 

1. A method, comprising: 

identifying two or more types of attributes of an information stream; 
encoding each identified attribute from the information stream; 
assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes sharing a common time reference; and 

generating a time ordered index of the identified attributes. 

2. The method of claim 1, wherein the information stream includes audio- visual data. 

3. The method of claim 1, wherein the information stream includes speech data. 

4. The method of claim 1, wherein at least one of the identified attributes comprises a 
scene change. 

5. The method of claim 1, wherein at least one of the identified attributes comprises a 
fade. 

6. The method of claim 1, wherein at least one of the identified attributes comprises a 
pan. 
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7. The method of claim 1, wherein at least one of the identified attributes comprises a 
human language type. 

8. The method of claim 1, wherein at least one of the identified attributes comprises a 
human accent. 

9. The method of claim 1, wherein at least one of the identified attributes comprises 
image characteristics. 

10. The method of claim 1, wherein at least one of the identified attributes comprises a 
spoken word. 

11. The method of claim 1 , wherein the identified attributes are encoded via extensible 
markup language. 

12. The method of claim 1, wherein the time ordered indication comprises a start time 
and a time frame in which the identified attribute was conveyed. 

13. The method of claim 1, wherein the common time reference comprises a frame 
count. 



Application 



29 



Atty. Docket No. 005827.P001 



14. The method of claim 1, wherein the common time reference comprises a time 
indication. 

15. The method of claim 1, further comprising generating a query on the one or more of 
identified attributes in the time ordered indexed. 

16. The method of claim 1, further comprising correlating a first identified attribute of 
the information stream with a second identified attribute having a similar time code. 

17. The method of claim 16, wherein the similar time code comprises the first identified 
attribute possessing a start time approximately the same as the second identified attribute 
or an overlapping of time frames associated with the first identified and the second 
identified attribute. 

18. The method of claim 1, further comprising: 

individually synchronizing each word in a transcript from the information stream 
to be frame accurate to corresponding video data based upon both sharing the common 
time reference. 

19. A machine-readable medium that stores instructions, which when executed by a 
machine, cause the machine to perform operations comprising: 

identifying two or more types of attributes of an information stream; 
encoding each of the identified attributes from the information stream; 
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assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes share a common time reference; and 

generating a time ordered index of the identified attributes. 

20. The article of manufacture of claim 19, which causes the machine to perform further 
operations comprising: 

generating a query on the one or more of the time ordered indexed identified 
attributes. 

21. The article of manufacture of claim 19, which causes the machine to perform further 
operations comprising: 

correlating a first identified attribute of the information stream with a second 
identified attribute having a similar time code. 

22. The method of claim 19, further comprising: 

individually synchronizing each word in a transcript from the information stream 
to be frame accurate to corresponding video data based upon both sharing the common 
time reference. 

23. An apparatus, comprising: 

means for identifying two or more types of attributes of an information stream; 
means for encoding each identified attribute from the information stream; 
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means for assigning a time ordered indication with each of the identified 
attributes, each of the identified attributes share a common time reference; and 
means for generating a time ordered index of the identified attributes. 

24. The apparatus of claim 23, further comprising: 

means for generating a query on the one or more of the time ordered indexed 
identified attributes. 

25. A method, comprising: 

converting spoken words in an information stream to written text, the information 
stream containing audio-visual information; and 

generating a separate encoded file for every word, each encoded file contains a 
time ordered indication reference to a relevant video frame. 

26. The method of claim 25, further comprising: 

detecting shot change information; and 

creating thumbnail images for each shot change; and 

generating an encoded file for every shot change, each encoded file containing a 
time ordered indication referencing to one or more corresponding spoken words. 

27. The method of claim 25, further comprising: 

generating a link to the corresponding relevant video frame based upon a user 
selecting one or more of the spoken words. 
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28. The method of claim 25, further comprising: 

generating a link to relevant material based upon the spoken words and 
synchronizing a display of the link in less than five seconds from analyzing the 
information stream. 

29. A machine-readable medium that stores instructions, which when executed by a 
machine, cause the machine to perform operations comprising: 

converting spoken words in an information stream to written text, the information 
stream containing audio-visual information; and 

generating a separate encoded file for every word, each encoded file contains a 
time ordered indication reference to a relevant video frame. 

30. The article of manufacture of claim 29, which causes the machine to perform the 
further operations comprising: 

detecting shot change information; and 
creating thumbnail images for each shot change; 

generating an encoded file for every shot change, each encoded file containing a 
time ordered indication referencing to one or more corresponding spoken words. 

31. The article of manufacture of claim 29, which causes the machine to perform the 
further operations comprising: 
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generating a link to relevant material based upon the spoken words and 
synchronizing a display of the link in less than five seconds from analyzing the 
information stream. 

32. An apparatus, comprising: 

means for converting spoken words in an information stream to written text, the 
information stream containing audio- visual information; and 

means for generating a separate encoded file for every word, each encoded file 
contains a time ordered indication reference to a relevant video frame. 

33. The apparatus of claim 32, further comprising: 

means for detecting shot change information; and 

means for creating thumbnail images for each shot change; 

means for generating an encoded file for every shot change, each encoded file 

containing a time ordered indication referencing to one or more corresponding spoken 

words. 

34. An apparatus comprising: 

a software engine operable to apply one or more attribute filters to detect 
attributes from an information stream, identify the attributes, and assign a time ordered 
indication with each of the identified attributes, the software engine having an index 
control module to facilitate time order indexing of the identified attributes in order to be 
frame accurate; and 
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a computer readable medium to store the software engine. 

35. The apparatus of claim 34, wherein the time ordered indication comprises a 
beginning frame count referenced to universal frame count referenced for all of the 
attributes from the information stream and an amount of frames in which the attribute was 
conveyed. 

36. The apparatus of claim 34, wherein the time ordered indication comprises a start time 
and a time frame in which the identified attribute was conveyed. 

37. The apparatus of claim 34, further comprising: 

a manipulation-module to perform operations on a first set of attributes in order to 
manipulate a second set of attributes. 

38. The apparatus of claim 37, wherein the first set of attributes compromises a section 
of transcripted text and the second set of attributes comprises video images having 
approximately the same time ordered indications as the transcripted text. 

39. The apparatus of claim 34, further comprising: 

a triggering and synchronization module to dynamically trigger a link and 
synchronize the appearance of the link based upon a transcripted text from the 
information stream. 
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40. A machine-readable medium that stores instructions, which when executed by a 
machine, cause the machine to perform operations comprising: 

identifying one or more attributes of an information stream from a live broadcast; 

encoding each of the identified attributes from the information stream; 

assigning a time ordered indication with each of the identified attributes, each of 
the identified attributes share a common time reference; and 

generating a synchronized link to relevant material based on the content of the live 
broadcast, the synchronized link to be displayed with the live broadcast. 

41. The article of manufacture of claim 40, which causes the machine to perform further 
operations comprising: 

synchronizing the synchronized link to appear at approximately an utterance of the 
most relevant word related to the content of the live broadcast. 

42. An apparatus, comprising: 

means for identifying one or more attributes of an information stream from a live 
broadcast; 

means for encoding each of the identified attributes from the information stream; 

means for assigning a time ordered indication with each identified attribute, each 
identified attribute shares a common time reference measurement; and 

means for generating a synchronized link to relevant material based on the content 
of the live broadcast, the synchronized link to be displayed with the live broadcast. 
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43. The apparatus of claim 42, further comprising: 

means for synchronizing the link to appear at approximately an utterance of the 
most relevant word related to the content of the live broadcast. 

»jc sjc •{« sjc jjc 
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